Optimal finite-time processes in stochastic thermodynamics 
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For a small system like a colloidal particle or a single biomolecule embedded in a heat bath, 
the optimal protocol of an external control parameter minimizes the mean work required to drive 
the system from one given equilibrium state to another in a finite time. In general, this optimal 
protocol obeys an integro-differential equation. Explicite solutions both for a moving laser trap and 
a time- dependent strength of such a trap show finite jumps of the optimal protocol to be typical 
both at the beginning and the end of the process. 
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like the Jarzynski relation Q and various generalizations 
thereof have been derived theoretically 0, EI and 



Introduction.- The concepts of classical thermodynam- 
ics like applied work and exchanged heat can be ap- 
plied to soft and biomatter systems as the study of the 
driven dynamics of single colloidal particles and of single 
biomolecules has shown Since thermal fluctuations 
contribute substantially, work and heat acquire a stochas- 
tic contribution and must be described by probability dis- 
tributions. Exact results constraining such distributions 

us generalizat 

tested experimentally [& |3, LLfJ, [ill, ■ Typically, these 
exact relations hold for any time-dependent driving de- 
scribed by an external control parameter A(r). 

In this paper, we ask for the optimal protocol A*(r) 
that minimizes the mean work required to drive such a 
system from one equilibrium state to another in a finite 
time t. The emphasis on a finite time is crucial since for 
infinite time the work spent in any quasi-static process is 
equal to the free energy difference of the two states. For 
finite time the mean work is larger and will depend on the 
protocol A(t). Knowing the optimal protocol A*(r) could 
inter alia improve the extraction of free energy differences 
from finite-time path samp ling both in various numerical 
schemes [lljlljll, El, Ell EI 0, HI and in experimen- 



tal studies [2l|, [22| . Quite generally, the smaller the mean 



work is, the better the statistics for free energy estimates 
becomes 17J, l23[. A priori, one might expect the optimal 
protocol connecting the given initial and final values to 
be smooth as it was found recently in a case study within 
the linear response regime [24| . In contrast, as our main 
result, we find here for genuine finite-time driving that 
the optimal protocol involves discontinuities both at the 
beginning and the end of the process. 

For macroscopic systems, optimal processes have been 
investigated under the label of finite-time thermodynam- 
ics for quite some time p5. 2rj 27 1. Indeed, jumps were 
found there as well |26[ despite the significant differ- 
ences both in the role of heat baths and the equations 
of motion between macroscopic and stochastic thermo- 
dynamics. For the former, heat reservoirs of different 
temperature are typically involved in a search for opti- 
mal adaptions of, e.g., Carnot-like machines to finite time 



cycles. In our context, the system always remains in con- 
tact with a single heat bath of constant temperature T. 
Moreover, this heat bath provides thermal fluctuations 
which require a stochastic formulation in contrast to the 
deterministic description in macroscopic finite-time ther- 
modynamics. 

The model.- Paradigmatically, a Langcvin equation 
describes the driven overdamped motion of a single de- 
gree of freedom with co-ordinate x in a time-dependent 
one-dimensional potential V(x, A(r)) as 



(1) 



Here, /i is the mobility and time-derivatives are denoted 
by a dot throughout the paper. The thermal fluctua- 
tions are modelled as Gaussian white noise (C( r )C( T ')) = 
2fiksTS(T — r'), with fee as Boltzmann's constant. The 
time evolution of the probability distribution p(x, r) to 
observe the particle at position x at time r is then gov- 
erned by the Fokker-Planck equation 



d T p(x,r) = d x 



/' 



dV 
dx 



IxknTdx 



p{x, 



(2) 



Initially, the system is in thermal equilibrium in the 
potential V(x, Aj). During the time-interval < t < 7, 
the control parameter A(r) is varied from A^ to the final 
value A/. The mean work spent in this process 



(x(t),\(t)) 



(3) 



becomes a functional of the protocol [A(r)] where the 
average (....) is over the initial thermal distribution and 
over the noise history. For notational simplicity, we set 
kgT = fj, = 1 in the following by choosing natural units 
for energies and times. We will first investigate two case 
studies motivated by previously set up experiments on 
colloidal particles and then analyze the general case. 

Case study I: Moving laser trap.- As an almost trivial, 
but still instructive introductory example, we consider a 
colloidal particle dragged through a viscous fluid by an 
optical tweezer with harmonic potential 



V(x,t) = (x-\(t)Y /2. 



(4) 
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The focus of the optical tweezer is moved according to 
a protocol A(r). In previous experiments, suchprotocols 
have been used to test the fluctuation theorem [8| and the 
Hatano-Sasa relation The optimal protocol A*(t) 

connecting given boundary values Xi = and A/ in a time 
t minimizes the mean total work ([3]) which we express as 
a functional of the mean position of the particle u{t) = 
{x{t)) as 



W[X(t)} = [ drX(X-u) = [ dr{u + u)u 
Jo Jo 

drii 2 +[u 2 Y /2. 



Here, we have used 



u = (A — u) 



(5) 



(0) 



which follows from averaging the Langevin equation. 

The Euler-Lagrange equation corresponding to (O, 
ii = 0, is solved by u(t) = mr, where u(0) = is enforced 
by the initial condition. Eq. Q then requires the bound- 
ary conditions u(0) = Xi — u(0) — and ii(t) = A/ — mt 
which can only be met by discontinuities in ii at the 
boundaries which correspond to jumps in A. Note that 
these "kinks" do not contribute to the integral in the 
second line of eq. ©. The yet unknown parameter m 
follows from minimizing the mean total work 



W = m 2 t + (X f - mt) 2 /2 



(7) 



which yields m* = Xf /(t + 2). The minimal mean work 
W* = X 2 f /(t+2) vanishes in the quasi-static limit t — ► oo. 
The optimal protocol then follows from eq. ^ as 



A*(r)=A/(r+l)/(t + 2), 



(8) 



for < r < t. As a surprising result, this optimal proto- 
col implies two distinct symmetrical jumps of size 

AA = A(0+) - Xi = X f - X(t~) = X f /(t + 2) (9) 

at the beginning and the end of the process. 

A priori, one might have expected a continuous linear 
protocol A lm (r) = Xjr/t to yield the lowest work but the 
explicite calculation shows that 



W lin = (X f /t) 2 {t + e~* - 1) > W* 



(10) 



for any t > 0, with a maximal value W hn /W* ~ 1.14 at 
t ~ 2.69. 

In macroscopic finite-time thermodynamics, the occur- 
rence of such jumps has previously been rationalized by 
pointing out the special nature of this type of variational 
problem where the highest derivative (here it in eq. ([5|)) 
occurs linearly In the present model where fluctua- 
tions are irrelevant to the mean work, these jumps have 
the same formal origin. 



Case study II: Timc-dcpcndcnt strength of the trap.- 
In this example, fluctuations are crucial. We consider the 
motion of a colloidal particle in a trap whose strength be- 
comes time-dependent whereas its position remains con- 
stant. The corresponding potential reads 



V(x,t) = X(t)x 2 /2 



(11) 



with A(0) = Xi and X(t) = Xf > Xi as boundary condi- 
tions. Such a potential with a sudden jump protocol has 
been investigated experimentally as test of the fluctua- 
tion theorem 0. We first derive the equation of motion 
for the variance w(t) = (x 2 (t)) 



ill = -2Xw + 2 



(12) 



by multiplying eq. ([2]) with x 2 and integrating over x. 
The mean work ([3]) can then again be cast in a local 
functional of the new variable w and its first derivative 
by solving (TT2"]) for A 



W[X(r)}= f drX^^-lXw-lrxw^ + l f dAl3) 



The minimization of the work functional then requires 
solving the Euler-Lagrange equation 



Its general solution 

w(t) 



2ww = 0. 



ci(l + c 2 r) 5 



(14) 



(15) 



contains two constants. The thermal initial distribution 
w(0) = 1/Xi fixes ci = 1/Xi. The second constant C2 
follows from minimizing the total mean work 

w = ~ ln (1 + C2<) + ^ (A//Al) (1 + C2<)2 " \ (16) 



which leads to 



c\t = 



1 - Xft+ y/1 + 2X t t + XfXit 2 



2 + Xft 

The optimal protocol derived from eq. ([12"]) 
Xi - c|(l + c* 2 t) 



A*(t) 



(1 



(17) 



(18) 



for < t < t again implies jumps at the beginning and 
end of the process as shown in Fig. [1^,. Both the minimal 
work W* , see Fig. and the scaled optimal protocol 
X*(r/t)/Xi depend only on two parameters (A//Ai) and 
Xit. 

For the two limiting cases of an immediate jump, t — > 
0, and a quasi-static process, t — > oo, respectively, the 
values of W* also follow from general principles. For an 
immediate jump, the minimal work 



W^ = ]imW* = ( {Xf ~ Xi)x " 
t^o \ 2 



= 5«A//A i )-1) 
(19) 
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FIG. 1: (color online) Optimization results for a time-dependent strength A(r) of a laser trap for different values of {Xf/Xi) and 
Xit (case study II): (a) Optimal protocols X*/Xi as a function of the scaled time r/t. (b) Minimal work W* . (c) Logarithmic 
fraction ln{W* /W qB ) of the optimal work and the quasistatic work, (d) Relative height AX/Xf of the jump of the optimal 
protocol at t = in units of (W* - W qB )/W ip . 



is equal to the difference in energy evaluated in the ther- 
mal initial ensemble. In this limit, the optimal protocol 
A*(r)/A i w {{Xf/Xi) + l)/2 is constant for < r < t but 
has discontinuities at r = and t = t. In the quasi-static 
limit, the minimal work 



W qs = lim W* 



1 



ln(A//Ai) = AF 



(20) 



is equal to the free energy difference AF between the final 
and the initial state. In this limit, the optimal protocol 
is continous at r = and r = t and takes the form 



A*(r/i) 



A, 



i-(tA) + V(a77a7)(tA))' 



(21) 



For {Xf/Xj) 3> 1, the minimal work is of the order 
of the quasi-static work for any Xit* » 2/ln(A//A,) as 
a simple analysis of eqs. (fT6|) and (fTT]) shows. Thus, 
the larger the change of the control parameter A, the 
smaller is the time-interval required to essentially reach 
the quasi-static work, as quantitatively shown in Fig. [TJ;. 



The origin of this surprising features lies in the fact that 
the relaxation time scales like 1/A. For large A, the par- 
ticle can follow a larger change of the control parameter 
almost quasi-statically. Therefore, the optimal protocol 
can become quite steep towards the end of the process 
for large A / . 

General case. - For a general non-harmonic potential, 
it is not possible to express the mean work as a local 
functional of just one variable as we have done for the 
two harmonic cases. Rather, our optimization problem 
becomes non-local in time since changing the protocol at 
a time r affects the mean work increments for all later 
times r' > t. This fact becomes obvious by expressing 
the mean work as a path integral average 



W[X{t)} = / d[x{T)}p[x{r)} 



dTA 9A 



(22) 



over all possible trajectories x{t) with weight 

I" /■* f{± + d x V) 2 
p[x(r)] = J\fp(x, 0) exp — / dr 



dlv 



(23) 
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where J\f is a normalization constant. Minimizing the 
mean work ([3]) then requires solving the non-local Eulcr- 
Lagrange equation 



d_ /dV 



SW[X(t)} 
SX(a) 



(24) 



where the right hand side can be expressed by correlation 
functions as 



d /8V S 
d7 \ SA, 



dr- 



X 



d 2 V 
~dX? 



(25) 



cyclic processes combining mechanical steps with chemi- 
cal reactions given a finite cycle time. These perspectives 
to be investigated in future work demonstrate that the 
optimization problem introduced here for stochastic ther- 
modynamics has not only a broad fundamental signifi- 
cance. Its ramifications could ultimately also lead to the 
construction of "optimal" nano-machines. Finally, it is 
tempting to speculate which, if any, biological processes 
on the cellular and subcellular level have been optimized 
during evolution for their finite-time performance in the 
noisy cellular environment. 



/ d 3 V 
( dXd 2 x 



(x + d x V) 



d 2 V \ 
dXdx J 




In general, this integro-differential equation solved by the 
optimal protocol A*(r) looks rather inaccessible. Explor- 
ing a variational ansatz for A*(r) allowing for jumps with 
numerical evaluation of the mean work seems possible but 
may still be a formidable task to be explored in future 
work. 

In order to use jumps in the protocol A(r) for the effi- 
cient extraction of free energy differences from finite-time 
path sampling via the Jarzynski relation, one needs an 
estimate for the height of these jumps without knowing 
the underlying potential. For the moving laser trap (case 
study I), we get the relation AA/A/ = 2(W* -W^) /W ip . 
For case study II, we find numerically that the relative 
height of the jump AA/A/ at t = is also of the order 
of (W* - JF qs )/PF jp , see FigDJi. If such a relation gave 
the correct order of magnitude for the optimal jump in 
general cases, it could become a helpful tool for estimat- 
ing the optimal jump heights. For experimentally deter- 
mining the optimal protocol for an unknown potential, 
we envisage an adaptive procedure in which trial pro- 
tocols (including estimated trial jumps) are successively 
improved in an iterative fashion guided by the monitored 
work values. 

Concluding perspectives. - As a main qualitative re- 
sult, our analysis of two simple but experimentally re- 
alizable model cases has revealed that the optimal pro- 
tocol minimizing the mean work required to drive the 
system from one equilibrium state to another involves 
jumps of the external control parameter both at the be- 
ginning and at the end of the finite-time process. We 
expect such jumps to be a generic feature of the optimal 
protocol for arbitrary potentials. Even though we have 
investigated only a single degree of freedom, the exten- 
sion to many coupled degrees of freedom involves only 
minor notational complexity but poses no further con- 
ceptual challenge. 

We have focussed on optimal protocols connecting 
two different equilibrium states. An optimal protocol 
for transitions in finite-time between two different non- 
equilibrium stationary states could be investigated along 
similar lines in the context of steady-state thermodynam- 
ics Likewise, one can ask for the optimal protocol of 



[10 

[11 

[12 

[13 

[14 
[15 

[1(3 

[17 

[18 

[19 

[20 

['21 

[22 

[23 
[24 
[25 
[26 

[27] 



C. Bustamante, J. Liphardt, and F. Ritort, Physics To- 
day 58, 43 (2005). 

C. Jarzynski, Phys. Rev. Lett. 78, 2690 (1997). 
G. E. Crooks, Phys. Rev. E 61, 2361 (2000). 

T. Hatano and S. Sasa, Phys. Rev. Lett. 86, 3463 (2001). 

U. Seifert, Phys. Rev. Lett. 95, 040602 (2005). 

T. Speck and U. Seifert, J. Phys. A 38, L581 (2005). 

A. Imparato and L. Peliti, Europhys. Lett. 69, 643 
(2005). 

G. M. Wang, E. M. Sevick, E. Mittag, D. J. Searles, and 

D. J. Evans, Phys. Rev. Lett. 89, 050601 (2002). 

D. M. Carberry, J. C. Reid, G. M. Wang, E. M. Se- 
vick, D. J. Searles, and D. J. Evans, Phys. Rev. Lett. 92, 
140601 (2004). 

E. H. Trepagnier, C. Jarzynski, F. Ritort, G. E. Crooks, 
C. J. Bustamante, and J. Liphardt, Proc. Natl. Acad. 
Sci. 101, 15038 (2004). 

S. Schuler, T. Speck, C. Tietz, J. Wrachtrup, and 

U. Seifert, Phys. Rev. Lett. 94, 180602 (2005). 

V. Blickle, T. Speck, L. Helden, U. Seifert, and 

C. Bechinger, Phys. Rev. Lett. 96, 070603 (2006). 

D. A. Hendrix and C. Jarzynski, J. Chem. Phys. 114, 
5974 (2001). 

G. Hummer, J. Chem. Phys. 114, 7330 (2001). 

M. R. Shirts, E. Bair, G. Hooker, and V. S. Pande, Phys. 

Rev. Lett. 91, 140601 (2003). 

F. M. Ytreberg and D. M. Zuckerman, J. Chem. Phys. 
120, 10876 (2004). 

E. Atilgan and S. X. Sun, J. Chem. Phys. 121, 10392 
(2004). 

S. Park and K. Schulten, J. Chem. Phys. 120, 5946 
(2004). 

W. Lechner, H. Oberhofer, and C. Dellago, J. Chem. 
Phys. 124, 044113 (2006). 

F. M. Ytreberg, R. H. Swendsen, and D. M. Zuckerman, 
J. Chem. Phys. 125, 184114 (2006). 

J. Liphardt, S. Dumont, S. B. Smith, I. Tinoco Jr, and 

C. Bustamante, Science 296, 1832 (2002). 

D. Collin, F. Ritort, C. Jarzynski, S. Smith, I. Tinoco, 
and C. Bustamante, Nature 437, 231 (2005). 

C. Jarzynski, Phys. Rev. E 73, 046105 (2006). 

M. de Koning, J. Chem. Phys. 122, 104106 (2005). 

F. L. Curzon and B. Ahlborn, Am. J. Phys. 43, 22 (1975). 

Y. B. Band, O. Kafri, and P. Salamon, J. Appl. Phys. 

53, 8 (1982). 

B. Andresen, P. Salamon, and R. S. Berry, Physics Today 
37, 62 (1984). 



